Postponing Branching Decisions 

Willem Jan van Hoeve* and Michela Milano^ 
July 16, 2004 



Abstract 

Solution techniques for Constraint Satisfaction and Optimisation Prob- 
lems often make use of backtrack search methods, exploiting variable and 
value ordering heuristics. In this paper, we propose and analyse a very 
simple method to apply in case the value ordering heuristic produces ties: 
postponing the branching decision. To this end, we group together 
values in a tie, branch on this sub-domain, and defer the decision among 
them to lower levels of the search tree. We show theoretically and ex- 
perimentally that this simple modification can dramatically improve the 
efficiency of the search strategy. Although in practise similar methods 
may have been applied already, to our knowledge, no empirical or theo- 
retical study has been proposed in the literature to identify when and to 
what extent this strategy should be used. 

1 Introduction 

Constraint Satisfaction Problems (CSPs) and Constraint Optimisation Prob- 
lems (COPs) are denned on a set of variables representing problem entities. 
Variables range on finite domains and are subject to a set of constraints that 
define the feasible configurations of variable-value assignments. A COP in ad- 
dition has an objective function to be optimised. A solution to a CSP or a COP 
is a variable- value assignment respecting all constraints, and optimising the ob- 
jective function if present. When being solved with Constraint Programming, 
the solution process interleaves constraint propagation and search. 

A general way of building a search tree for solving CSPs and COPs is called 
labelling. Labelling consists in selecting a variable and assigning it a single value 
from its domain. The variable and value selection are guided by heuristics. 
In particular, a value-selection heuristic ranks values in such a way that the 
most promising value is selected first. Concerning value-selection heuristics, we 
consider the following situations. 

If the heuristic regards two or more values equally promising we say the 
heuristic produces a tie, consisting of equally ranked domain values. The def- 
inition of ties can be extended to the concept of heuristic equivalence |2] that 
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considers equivalent all values that receive a rank within a given percentage 
from a value taken as reference. 

A similar situation occurs when different domain value heuristics are ap- 
plied simultaneously. Often a problem is composed of different aspects, for 
instance optimisation of profit, resource balance, or feasibility of some problem 
constraints. For each of those aspects a heuristic may be available. However, 
applying only one such heuristic often does not lead to a globally satisfactory 
solution. The goal is to combine these heuristics into one global domain value 
heuristic. Many combinations are used in practise: (i) to follow the heuristic 
that is regarded most important, and apply a different heuristic on values be- 
longing to the tie, (ii) to define a new heuristic (that might still contain ties) as 
the (weighted) sum of the ranks that each heuristic assigns to a domain value or 
(iii) rank the domain values through a multi- criteria heuristic. In this third case, 
a domain value has a higher rank than another domain value if it has a higher 
rank with respect to all heuristics. With respect to the multi-criteria heuristic, 
some values may be incomparable. These incomparable values together form a 
tie. 

The two cases considered above describe the same situation: the used heuris- 
tic^) define(s) a partial order on the values' ranks. In these cases, labelling 
chooses one of these values and branches on it. In traditional tree search values 
are chosen according to a deterministic rule, for instance lexicographic order. 
More recently, randomisation has been applied to these choices, see We pro- 
pose a simple, yet effective method that improves the efficiency of tree search in 
these situations: avoid making this choice and postpone the branching decision. 

Postponing branching decisions is practically used upon backtracking in 
scheduling applications pQ when the chronological heuristic is chosen. We select 
the activity A with the smallest earliest start time est and assign it to this 
value. Upon backtracking, we postpone the decision for A and go on assigning 
a different activity. The motivation underlying this postponement is that after 
a schedule that assigns activity A to est is found (or the search has failed), it is 
unlikely that assigning activity A to est + 1 would produce much better results. 
Indeed, values est and est + 1 are equivalent (i.e., form a tie) for the scheduling 
application. 

We propose here to apply decision postponement systematically in case of 
ties. Therefore, equivalent values are grouped together in a sub-domain and a 
branching is performed on the whole sub-domain, while those that are clearly 
ranked by the heuristic are still assigned singularly to a variable. We call this 
method partitioning. Even this simple change can dramatically improve the 
efficiency of the tree search, as we will see later. In addition, partitioning has 
another important advantage: it enhances the bound computation (in particular 
when used in conjunction with LDS), as shown in [7] where a strategy using 
partitioning is presented. Moreover, partitioning generates sub-problems, to 
which any appealing search method may be applied, speeding up the solution 
process. However, partitioning has also some drawbacks. In particular, when 
constraint propagation heavily relies on variable instantiation, partitioning may 
result in less propagation. Nevertheless, when we apply a fast solution method 
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to the generated sub-problems, partitioning can still be favourable instead of 
labelling. 

Although domain partitioning and labelling have been already used for solv- 
ing CSPs and COPs, to our knowledge there is no theoretical and practical 
study that indicates to practitioners when they should be applied. In this paper 
we discuss the effect of domain partitioning to search strategies that include 
depth-first search, limited discrepancy search and variants. 

The outline of this paper is as follows. In Section [2] we define the concepts 
and the background of our work. In Section [21 a theoretical comparison of par- 
titioning and labelling is given. This is followed by an experimental comparison 
in Section 21 We conclude with a discussion in Section [SJ 

2 Background 

A constraint satisfaction problem (CSP) consists of a set of variables Xi, . . . , x n 
with respective finite domains D\ , . . . , D n , and a set of constraints C on these 
variables. A constraint optimisation problem (COP) is a CSP together with an 
objective function to be optimised. 

We recall the concepts of labelling and partitioning, which are standard and 
widely used in search strategies for solving CSPs and COPs. During the search 
for a solution, a search tree is built by subsequently taking branching decisions. 
A branching decision implies first a variable selection. Then, labelling chooses a 
single value and assigns the variable to that value. Upon backtracking another 
value is assigned until no more values can be found in the domain. Formally, 
for variable Xj, labelling generates the assignments 

Xi = V Xi = di 2 V . . . V Xi = d k 

where D l = {d h , . . .,d H }. 

On the other hand partitioning is a technique that partitions the domain 
of a variable and branches on the resulting sub-domains, which may consist of 
only a single value. A very simple example, widely used in CSPs, is to split 
a numerical domain in two sets: the first containing values smaller or equal 
than a given threshold T, the second containing values greater than T. For 
example, if a variable A ranges on a domain {1, . . . , 10} the partitioning can 
be A < 5 V I > 5. This domain can also be partitioned in different ways 
like A G {4, 5, 6} V A G {1, 3, 7, 8} V A £ {2, 9, 10}. Formally, for variable x,, 
partitioning generates the branching 

Xi e d] v x t e d\ v . . . v x t e Df 

where Dj, . . . D™ is a partition of Di. In this work, the partition will be defined 
by the ties of the value-selection heuristic, i.e. each Dl consists of all values 
belonging to the same tie. 

Constructing a search tree via labelling leads to the appearance of leaves only 
at depth n. Constructing a search tree via partitioning leads to a sub-problem 
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at depth n. If all assigned sub-domains are single-valued, this sub-problem is a 
leaf. Otherwise, the sub-problem must be searched again, through labelling or 
partitioning. In this paper, we will always search the sub-problem via labelling. 
This means that the leaves of the search tree appear at depth between n and 
2n. 

A search strategy defines the order in which the nodes of a search tree are 
being traversed. We consider in this paper only depth-first based search strate- 
gies. A depth-first based search strategy traverses the search tree by going from 
a node to one of its successors, until it reaches a leaf. Examples of depth-first 
based search strategies are depth- first search (DFS), limited discrepancy search 
(LDS) 0] and depth-bounded discrepancy search (DDS) [TT| . 

A discrepancy (of a certain value) is a branching decision that is not selected 
first by the domain value ordering heuristic. For LDS and DDS, the cumulative 
discrepancy of a path from the root to a node may not exceed a given limit. 
LDS gradually allows this limit to increase during search. DDS follows LDS 
until a certain depth, but allows only heuristic choices (discrepancy 0) below 
this depth. The value of discrepancy of a branching decision is equal to the 
number of preceding branching decisions at the current tree node. In case of 
labelling, the discrepancy increases with value 1 for each domain value. For 
partitioning, the discrepancy value increases with the number of domain values 
in each sub-domain. However, below depth n, i.e. inside a sub-problem, we say 
that no branching decision increases the discrepancy. 

3 Theoretical Comparison 

This section shows, on a probabilistic basis, that partitioning is more beneficial 
than labelling in case the (combined) heuristic produces ties. In this section we 
do not consider constraint propagation. 

Similar to the analysis of LDS by Harvey and Ginsberg 0], we introduce a 
probability that the heuristic makes a correct choice. Let the search tree con- 
sist of good and bad nodes. A node is called good if one of its successors is a 
(optimal) solution to the CSP. Otherwise, the node is called bad. The heuristic 
probability is the probability that at a good node, the heuristic selects a good 
node first. Every following node selection has a similar probability of being a 
good node. For simplicity, Harvey and Ginsberg assume that this probability 
remains constant throughout the search tree. To analyse DDS, Walsh in- 
troduces a similar probability, but explicitly assumes that it increases with the 
depth. In both cases, binary search trees are considered, while our analysis is 
not restricted to binary trees. 

The analysis of partitioning with respect to labelling should be based on 
the sole fact that the heuristic produces ties. Hence, we may assume that the 
heuristic probability remains constant throughout the search tree. The heuristic 
probability is denoted by pf, corresponding to assigning value d S Di to variable 

Xi . Note that 53<ze-D Pi = •"■> an< ^ we explicitly assume p i * J > p^ k if the heuristic 
prefers di- over di k . If the heuristic produces a tie for xi , including values dj . 
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Figure 1: Cumulative probability of success using DFS and LDS. 



and d ik , then p i * 3 = ■p l ** . 

Let a search tree be defined by a certain variable ordering and domain value 
heuristic. A leaf I of the search tree consists of the instantiation of all n variables: 



I = {xi = d ij | d ij e Di,i e {1, . . . ,n}}. 

Thus, a leaf can either be a (optimal) solution or not. The probability of a leaf 
I being successful is 

P rob(o= n pp- 

{xi=di . )ez 

3 

When we apply a certain search strategy to a tree defined by labelling or by 
partitioning, leaves are visited in a different order. An example of the probabil- 
ity distribution along the leaves of the different search trees is given in Figure ^ 
The trees correspond to 2 variables, both having 3 domain values. The branches 
are ordered from left to right following the heuristic's choice. The heuristic prob- 
ability of success for is shown for each branch. Note that the heuristic produces a 
tie, consisting of two values, for the first variable. Labelling follows the heuristic 
on single values, while partitioning groups together values in the tie. For DFS 
and LDS, the order in which the leaves are visited is given, together with the 
cumulative probability of success. Note that for every leaf, partitioning always 
has a higher (or equal) cumulative probability of success than labelling. This 
will be formalised in Theorem ^ Note also that in a sub-problem generated 
by partitioning all leaves have the same probability of success. This property 
follows immediately from the construction of the sub-problems. As a conse- 
quence, any search strategy applied to this sub-problem will be equally likely to 
be successful. In practise, we will therefore use DFS to solve the sub-problems. 

Theorem 1 For a fixed variable ordering and a domain value ordering heuris- 
tic, let Tiaboi be the search tree defined by labelling, and let T par tition be the search 
tree defined by partitioning, grouping together ties. Let the set of the first k leaf 
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nodes visited by labelling and partitioning be denoted by £f abe i and £p art ition re ~ 
spectively. If Ti a b e ] and T par tition are traversed using the same depth-first based 
search strategy then 

prob(/)> P rob ^)- C 1 ) 

Proof. For k = 1, Q obviously holds. Let fc increase until labelling and 
partitioning visit a leaf with a different probability of success, say Zj_ abel and 
partition reS p ec ^j ve |y jf such leaves do not exist, (JJJ holds with equality for all 
k. 

Assume next that such leaves do exist, and let l 1 ^" 21 and ;P altltlon b e t ne first 
leaves with a different probability of success. As the leafs are different, there is 
at least one different branching decision between the two. The only possibility 
for this different branching decision is that we have encountered a tie, because 
partitioning and labelling both follow the same depth-first based search strat- 
egy. This tie made partitioning create a sub-problem S, with /P altltlon g 5^ anc [ 
^labci ^ g jf labelling m ade a branching decision different from partitioning, 
with a higher probability of being successful, then partitioning would have made 
the same decision. Namely, partitioning and labelling follow the same strategy, 
and the heuristic prefers values with a higher probability. So it must be that 
a different branching decision made by labelling has a smaller or equal prob- 
ability of being successful with respect to the corresponding decision made by 
partitioning. However, as we have assumed that prob(7£ artltlon ) =/= prob(7[? bcl ), 
there must be at least one different branching decision made by labelling, that 
has a strictly smaller probability of being successful. Thus for the current k, Q 
holds, and the inequality is strict. 

As we let k increase further, partitioning will visit first all leaves inside S 1 , 
and then continue with ^ abo1 . On the other hand, labelling will visit leaves / 
that are either in S or not, all with prob(Z) < prob(7£ artltIon ). However, as par- 
titioning follows the same search strategy as labelling, partitioning will cither 
visit a leaf of a sub-problem, or a leaf that labelling has already visited (possibly 
simultaneously). In both cases, J2ieL k prob(7) > J2ieL k prob(Z). □ 



Next we measure the effect that the number of ties has on the performance 
of partitioning with respect to labelling. For this reason, we vary the number 
of ties in a fixed search tree of depth 30. A branch- width of 3 will be used in all 
cases, as this allows ties, and a larger branch-width would make it impractical to 
measure effectively the performance of labelling. Depending on the occurrence 
of a tie, the heuristic probability pi of branch i will be chosen either 

pi = 0.95, p 2 = 0.04, p 3 = 0.01 (no tie), or 
Pi = 0.495, p 2 = 0.495, p 3 = 0.01 (tie). 

Our method assumes a fixed variable ordering in the search tree, and uniformly 
distributes the ties among them. This is reasonable, since in practise ties can 
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a. using DFS 



b. using LDS 



Figure 2: Partitioning versus labelling on search trees of depth 30 and branch- 
width 3. 

appear unexpectedly. We have investigated the appearance of 10%, 33% and 
50% ties out of the n branching decisions that lead to a leaf. In Figure EJa and 
b., we report the cumulative probability of success for labelling and partitioning 
using DFS and LDS until 50000 leaves. Note that in Figure [3a the graphs for 
labelling with 33% and 50% ties almost coincide along the x-axis. The figures 
show that in the presence of ties partitioning may be much more beneficial than 
labelling, i.e. the strict gap in 0) can be very large. 

4 Experimental Comparison 

This section presents computational results of two applications for which we 
have compared partitioning and labelling. The first is the Travelling Sales- 
man Problem (TSP), the second the Partial Latin Square Completion Problem 
(PLSCP). We first explain the reason why we chose these two problems among 
a set of problems considered to test the methods. The TSP is an optimisa- 
tion problem where the propagation is quite poor and the heuristic used is very 
informative but produces (not very large indeed) ties. Instead, PLSCP is a con- 
straint satisfaction problem whose model contains many alldifferent constraints 
whose filtering algorithm is particularly effective. The heuristic used is quite 
good and sometimes produces ties. Therefore, the two problems have opposite 
structure and characteristics. For the TSP partitioning is very suitable since 
the only drawback of the method, i.e., the decreased effect of propagation, does 
not play any role. On the contrary, the PLSCP is a problem whose characteris- 
tics are not suitable for the partitioning. Therefore, we will point out also the 
weakness of the method. For each application we state the problem, define the 
applied heuristic and report the computational results. For both problems we 
apply LDS as search strategy. 

The applications are implemented on a Pentium lGhz with 256 MB RAM, 
using ILOG Solver 5.1 and Cplex 7.1 0. 
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N.A. means 'not applicable' due to time limit (900 s). 



Table 1: Results for rinding optima of TSP instances (not proving optimality). 

4.1 Travelling Salesman Problem 

The travelling salesman problem (TSP) is a traditional NP-hard combinatorial 
optimisation problem. Given a set of cities with distances (costs) between them, 
the problem is to find a closed tour of minimal length visiting each city exactly 
once. 

For the TSP, we have used a constraint programming model and a heuristic 
similar to |S] based on reduced costs. Sub- problems are being solved using DFS, 
since all leaves can be considered to have equal probability of being successful. 

To compare labelling and partitioning fairly, we stop the search as soon as 
an optimal solution has been found. For the considered instances, the optimal 
values are known in advance. The proof of optimality should not be taken into 
account, because it is not directly related to the probability of a branch being 
successful. 

The results of our comparison are presented in Tabled The instances are 
taken from TSPLIB ^H] and represent symmetric TSPs. For labelling and 
partitioning, the table shows the time and the number of fails (backtracks) 
needed to find an optimum. For labelling, the discrepancy of the leaf node 
that represents the optimum is given. For partitioning, the discrepancy of the 
sub-problem that contains the optimum is reported. 

For all instances but one, partitioning performs much better than labelling. 
Both the number of fails and the computation time are substantially less for 
partitioning. Observe that for the instance 'dantzig42' labelling needs less fails 
than partitioning, but uses more time. This is because partitioning solves the 
sub-problems using DFS. Partitioning can visit almost three times more nodes 
in less time, because it lacks the LDS overhead inside the sub-problems. 

4.2 Partial Latin Square Completion Problem 

The Partial Latin Square Completion Problem (PLSCP) is a well known NP- 
complete combinatorial satisfaction problem. A Latin square is an n x n square 



8 





labelling 




partitioning 




instance 


time (s) 


fails 


discr 


time (s) 


fails 


discr 


b.o25.h238 


2.36 


668 


5 


1.09 


746 


5 


b.o25.h239 


0.49 


15 


1 


0.42 


2 


1 


b.o25.h240 


1.17 


179 


4 


0.86 


893 


4 


b.o25.h241 


3.31 


772 


3 


4.70 


3123 


4 


b.o25.h242 


2.41 


537 


3 


1.80 


1753 


4 


b.o25.h243 


4.06 


1082 


4 


3.96 


2542 


4 


b.o25.h244 


1.33 


214 


3 


2.99 


2072 


4 


b.o25.h245 


9.40 


2308 


6 


10.66 


12906 


7 


b.o25.h246 


2.01 


401 


5 


2.22 


1029 


4 


b.o25.h247 


258.91 


69105 


6 


11.66 


5727 


4 


b.o25.h248 


33.65 


6969 


5 


0.68 


125 


2 


b.o25.h249 


212.76 


60543 


11 


101.46 


85533 


8 


b.o25.h250 


2.45 


338 


2 


0.83 


687 


3 


u.o30.h328 


273.53 


32538 


4 


82 


14102 


3 


u.o30.h330 


21.79 


2756 


3 


25.15 


5019 


3 


u.o30.h332 


235.40 


30033 


5 


56.94 


9609 


3 


u.o30.h334 


4.18 


256 


2 


6.09 


843 


2 


u.o30.h336 


1.73 


69 


2 


0.76 


12 


1 


u.o30.h338 


49.17 


5069 


3 


29.41 


8026 


3 


u.o30.h340 


1.68 


91 


2 


0.81 


66 


2 


u.o30.h342 


28.40 


3152 


3 


5.41 


600 


2 


u.o30.h344 


9.05 


605 


2 


8.35 


1103 


2 


u.o30.h346 


2.15 


101 


2 


3.76 


482 


2 


u.o30.h348 


43.80 


2658 


2 


32.86 


2729 


2 


u.o30.h350 


1.16 


46 


1 


0.80 


12 


1 


u.o30.h352 


5.10 


288 


2 


0.95 


32 


1 


sum 


1211.45 


220793 


91 


396.62 


159773 


81 


mean 


46.59 


8492.04 


3.50 


15.25 


6145.12 


3.12 



Table 2: Results for PLS completion problems. 

in which each row and each column is a permutation of the numbers {1, . . . , n}. 
A partial Latin square is a partially pre-assigned square. The PLSCP is the 
problem of extending a partial Latin square to a feasible (completely filled) 
Latin square. 

The constraint programming model is straightforward, using alldifferent con- 
straints on the rows and the columns, with maximal propagation. The maximal 
alldifferent propagation (achieving hyper-arc consistency [5]) is of great impor- 
tance for solving the PLSCP. With less powerful propagation, the considered 
instances are practically unsolvable. 

As heuristic we have used a simple first-fail principle for the values, i.e. 
values that are most constrained are to be considered first. Therefore the rank 
of a value is taken equal to the number of the value's occurrences in the partial 
Latin square, and a higher rank is regarded better. Hence, labelling selects 
the value with the highest rank, and uses lexicographic ordering in case of ties. 
Partitioning selects the sub-domain consisting of all values having the highest 
rank. The sub-problems are again being solved using DFS. For both labelling 
and partitioning, constraint propagation is applied throughout the whole search 
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tree. 

In Table|2]we report the performance of labelling and partitioning on a set of 
partial Latin square completion problems. It follows the same format as Tabled 
The instances are generated with the PLS-generator Following remarks 
made in 3 , our generated instances are such that they are difficult to solve, i.e. 
they appear in the transition phase of the problem. The instances 'b.o25.hm' 
are balanced 25 x 25 partial Latin squares, with m unfilled entries (around 
38%). Instances 'u.o30.hm' are unbalanced 30 x 30 partial Latin squares, with 
m unfilled entries (around 38%). 

Although partitioning performs much better than labelling on average, the 
results are not homogeneous. For some instances labelling has better perfor- 
mances w.r.t. partitioning. This can be explained by the pruning power of 
the alldifferent constraint. Since partitioning branches on sub-domains of car- 
dinality larger than one, the alldifferent constraint will remove less inconsistent 
values compared to branching on single values, as is the case with labelling. 
Using partitioning, such values will only be removed inside the sub-problems. 
However, even in instances where partitioning is less effective, the difference 
between the two strategies is not so high, while on many instances partitioning 
is much more effective. 

As was already mentioned in Section EL"Tl partitioning effectively applies DFS 
inside the sub-problems. For a number of instances, partitioning finds a solution 
earlier than labelling, although making use of a higher number of fails. 

5 Discussion 

We have seen both theoretically and experimentally that partitioning is to be 
preferred over labelling, when some domain values are incomparable with respect 
to one or more heuristics. There are several additional benefits to partitioning, 
of which we would like to mention two. Thereafter we discuss various drawbacks 
of partitioning. 

The sub-problems that are created by partitioning may be subject to any 
applicable search method. In particular, when the sub-problems are large, one 
could apply a local search method. Another possibility is to apply a (mixed- 
integer) (non)linear programming solver. This allows the user to effectively 
combine several solution methods to solve the problem. 

For COPs, proving optimality is often more difficult than finding a good 
solution. Partitioning can sometimes be useful to prove optimality earlier. In 
jS] , partitioning is applied to a domain value ordering heuristic based on reduced 
costs, together with LDS. For that particular case, the partitioning scheme 
allows a very effective bound computation. 

On the other hand, branching on sub-domains instead of single values de- 
creases the effect of constraint propagation. This is a serious drawback of parti- 
tioning, as we have seen in Sect ion FOl It also affects the bound computation of 
COPs. As was suggested in 7 , 'additive bounding' procedures may be helpful 
in this case. 



10 



Finally, we have only considered partitioning on depth-first based search 
strategies. We are currently investigating the possibility to effectively apply 
partitioning to breadth-first based search strategies as well. 

References 

[1] P. Baptiste, C. Le Pape, and W. Nuijten, Constraint- Based Scheduling, 
Kluwer Academic Publishers, 2001. 

[2] CP. Gomes, B. Selman, and H. Kautz, 'Boosting Combinatorial Search 
Through Randomization', in Proceedings of the Fifteenth National Confer- 
ence on Artificial Intelligence (AAAI'98), pp. 431-437, (1998). 

[3] CP. Gomes and D. Shmoys, 'Completing Quasigroups or Latin Squares: A 
Structured Graph Coloring Problem', in Proceedings of the Computational 
Symposium on Graph Coloring and its Generalizations, (2002). 

[4] W. D. Harvey and M. L. Ginsberg, 'Limited Discrepancy Search', in Pro- 
ceedings of the Fourteenth International Joint Conference on Artificial In- 
telligence (IJCAI-95), volume 1, pp. 607-615, (1995). 

[5] ILOG. ILOG Cplex 7.1, Reference Manual, 2001. 

[6] ILOG. ILOG Solver 5.1, Reference Manual, 2001. 

[7] A. Lodi, M. Milano, and L.M. Rousseau, 'Discrepancy based additive 
bounding', in Ninth International Conference on the Principles and Prac- 
tice of Constraint Programming (CP '03), volume 2833 of LNCS, pp. 510- 
524. Springer Verlag, (2003). 

[8] M. Milano and W.J. van Hoeve, 'Reduced cost-based ranking for gener- 
ating promising subproblems', in Eighth International Conference on the 
Principles and Practice of Constraint Programming (CP '02), volume 2470 
of LNCS, pp. 1-16. Springer Verlag, (2002). 

[9] J.-C. Regin, 'A Filtering Algorithm for Constraints of Difference in CSPs', 
in Proceedings of the Twelfth National Conference on Artificial Intelligence 
(AAAI-94), volume 1, pp. 362-367, (1994). 

[10] G. Reinelt, 'TSPLIB - a Traveling Salesman Problem Library', ORSA Jour- 
nal on Computing, 3, 376-384, (1991). 

[11] T. Walsh, 'Depth-Bounded Discrepancy Search', in Proceedings of the 15th 
International Joint Conference on Artificial Intelligence (IJCAI), volume 2, 
pp. 1388-1393, (1997). 



11 



